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ON  APPROXIMATION  OF  THE  LEVEL  PROBABILITIES  AND  ASSOCIATED  DISTRIBUTIONS 


IN  ORDER  RESTRICTED  INFERENCE 

Tim  Robertson  and  F.  T.  Wright 

SUMMARY 

I 

The  use  of  much  of  the  distribution  theory  developed  for  order  re¬ 
stricted  inference  has  been  limited  by  the  lack  of  computation  algorithms 
for  the  "level  probabilities"  encountered  in  that  theory.  An  approxima¬ 
tion  for  these  level  probabilities,  which  accounts  for  the  pattern  of 
large  and  small  "weights,"  is  developed.  This  approximation  and  the  equal 
wights  approximation  are  examined  in  several  different  ways  including  the; 
use  of  randomly  generated  weight  sets.  Both  approximations  appear  to  be 
reasonable  for  weight  sets  having  a  moderate  amount  of  variability.  The 
juality  of  the  equal  weights  approximation,  as  a  function  of  the  amount 
of  variability  in  the  weights,  deteriorates  more  quickly  for  certain  pat¬ 
terns  of  large  and  small  weights  than  for  others.  Thus,  the  approximation 
based  upon  the  pattern  of  large  and  small  weights  is  a  significant  improve¬ 
ment  over  the  equal  weights  approximation.  Finally,  Siskind's  (1976) 
approximation,  which  can  be  applied  if  the  number  of  parameters  is  not 
too  large,  is  discussed. 


Key  words  and  phrases :  Order  restricted  inference,  level  probabilities, 
ohi-bnr-square  distribution. 
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3.  Introduction.  The  chi-bar-square  (x  )  and  E-bar-square  (E  ) 
distributions  are  fundamental  to  the  theory  of  order  restricted  hypothesis 
tests .  For  a  comprehensive  treatment  of  the  early  work  in  order  restricted 
inference  the  reader  may  consult  Barlow,  Bartholomew,  Bremner  and  Brunk 
(1972).  These  distributions  have  tail  probabilities  which  are  linear  com¬ 
binations  of  the  tail  probabilities  of  standard  distributions  and  they 
depend  upon  the  order  restriction  through  the  coefficients  in  these  linear 
combinations.  The  values  of  these  coefficients  are  the  probabilities  that 
the  order  restricted  maximum  likelihood  estimates  of  normal  means  assume 
specified  numbers  of  distinct  values,  which  are  called  levels.  These  prob¬ 
abilities  are  computed  under  the  hypothesis  that  the  population  means  are 
equal.  The  maximum  likelihood  estimates  are  based  upon  independent  samples 
from  each  of  the  populations  and  depend  upon  the  vector  of  relative  precisions 
of  the  sample  means  as  estimates  of  the  corresponding  population  means. 

The  precisions  will  be  referred  to  as  weights.  The  use  of  these  tests  has 
been  limited  by  the  fact  that  these  level  probabilities  can  be  virtually 
impossible  to  compute  if  the  weights  are  not  all  equal.  In  this  paper  we 
describe  a  technique  for  approximating  these  level  probabilities  for  a 
linear  order  restriction  and  for  unequal  precisions.  This  approximation 
is  based  upon  an  idea  of  Chase  (197M  and  uses  the  pattern  of  large  and 
small  relative  precisions.  It  seems  to  be  particularly  good  when  the  rela¬ 
tive  precisions  have  two  distinct  values.  However,  it  seems  to  provide  a 
satisfactory  approximation  as  long  as  the  variation  in  the  relative  preci¬ 
sions  is  not  too  large.  For  example,  our  study  of  the  case  of  five  means 
indicates  that  if  the  ratio  of  the  largest  relative  precision  to  the  small¬ 
est  relative  precision  is  no  more  than  h.7  then  this  approximation  provides 
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an  adequate  approximation  for  the  tail  probabilities  of  the  x  distribu¬ 
tion.  This  is  probably  due  to  the  lack  of  sensitivity  of  the  level  proba¬ 
bilities  to  changes  in  the  weights.  This  "robustness"  was  noticed  by  both 
Grove  (1980)  and  Siskind  (1976).  Siskind  conjectured  that,  because  of  this 
robustness,  the  equal  weights  case  should  provide  reasonable  approximations 
except  in  extreme  cases. 

T n  Section  2  we  provide  some  background  on  the  computation  of  these 
level  probabilities  and  report  upon  our  investigation  of  Siskind's  conjec¬ 
ture  about  the  adequacy  of  the  equal  weights  approximation.  It  appears 
that  the  quality  of  the  equal  weights  approximation  is  related  to  the  pat¬ 
tern  of  large  and  small  weights  and  in  Section  3  we  explore  another  approx¬ 
imation  which  is  based  upon  such  patterns.  The  equal  weights  case  is  used 
as  a  benchmark  for  judging  this  new  approximation.  In  Section  h  we  briefly 
discuss  Siskind's  (1976)  approximation  for  the  level  probabilit.i es . 


2.  Preliminaries  and  the  equal  weights  approximation.  Suppose  we  have 
independent  random  samples  from  each  of  k  normal  populations  having  means 
Hj  ,pi0,  •  •  •  and  assume  that  the  corresponding  sample  means  and  sample 

sizes  are  denoted  by  x^  ,x^ ,  *  •  •  ,x^.  and  n^  ,n^  ,  •  •  ■  ,n^ .  Let  Pw(A,k)  de¬ 
note  the  probability  that  the  maximum  likelihood  estimates  of 
subject  to  the  linear  order  restriction  H  :  s  (i,  s  '"s  ^  have 

exactly  l  distinct  levels.  These  level  probabilities  are  computed  under 
the  assumption  that  U  =  p.^  =  •  •  •  =  and  they  depend  upon  the  vector 

w  =  (w  ,w  , • • •  ,w  )  of  relative  precisions  of  the  sample  means,  x. ,  as 
-L  c  K  l 

estimates  of  the  corresponding  population  means,  p^;  i  =l,2,--,,k.  We 

p 

•m  1:  cuiiii  up  lint  oil. her  the  population  variances  ,  0  ;  i  *  1  ,  *  *  *  ,k  are 

The  value  of  w.  is  tl./O. 

1  1  1 


known  or  if  unknown  they  are  assumed  equal. 


in  the  former  case  and  this  value  is  n.  in  the  latter. 

1 

For  k  ^  5  and  for  arbitrary  weights,  formulas  for  P  (X,k)  are  given 

on  pages  lUO-l^P  of  Barlow  et  al .  (1972).  There  are  typographical  errors 

in  the  formulas  for  P  (3,5)  and  P  (l,U).  The  formula  for  P  (5,5) 

w  w  w 

involves  an  integral  which  may  be  evaluated  numerically  or  approximated 
using  methods  described  in  Barlow  et  al.  (1972).  Cran  (l98l)  gives  a  com¬ 
puter  algorithm  for  the  computation  of  P  (jfc,k)  for  k  ^  U  and  for  their 

w 

approximation  for  k  =  5,6.  For  k  =  5  he  uses  an  approximation  due  to 
i'lackett  (195^)  and  for  k  =  6  he  uses  an  approximation  due  to  Childs  (1967). 
For  the  equal  weights  case,  that  is,  w  =w  =  •••  =w  ,  a  recursion 

X  (—  K 

formula  for  computing  P  (i,k)  is  given  in  Corollary  B  on  page  1U5  of 

w 

Barlow  et  al.  (1972).  This  formula  is  a  quite  satisfactory  computation 
algorithm  for  this  important  special  case.  We  denote  the  equal  weights 
level  probabilities  by  P(i,k).  The  generating  function  of  the  sequence 
{P( /,k) 3^_1  is  given  by 

4  t  \  _  / s+k-l\  _  s(s+l) • • • (s+k-l) 

Ys;  "  \  k  )  ”  k! 

Grove  (1980)  and  Siskind  (1976)  both  claimed  that  the  P  (/,k)'s  are 

w 

not  very  sensitive  to  changes  in  the  weights  and  that  the  equal  weights 
ease  should  provide  reasonable  approximations  except  for  extreme  cases. 

Siskind  felt  that  the  pattern  of  large  and  small  weights  was  important  and 
that  approximation  is  difficult  for  a  U-shaped  configuration  of  weights, 

that  is,  for  weight  sets  with  w  and  w  relatively  large  and  the  other 

X  K 

w.  small, 
l 

For  the  most  part,  we  will  judge  approximations  as  they  apply  to 
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Bartholomew's  x  distribution.  The  tail  probabilities  of  this  distribu¬ 
tion  are  given  by 


prv[X^t]  =1^  Pw(i,k)pr[X^_1^t] 

2 

where  X£_-^  denotes  a  standard  chi-square  variable  having  X- 1  degrees 
2 

freedom  (XQ  —  0).  Distributions,  which  have  tail  probabilities  which  are 
linear  combinations  of  the  tail  probabilities  of  standard  distributions 
arise  in  several  restricted  testing  problems.  In  addition  to  those  dis¬ 
cussed  in  Barlow  et  al.  (1972),  see  Robertson  and  Wegman  (1978),  Robertson 
(1978),  Grove  (1980),  Robertson  and  Wright  (1981),  Robertson  and  Warrack 
(1981),  and  Dykstra  and  Robertson  (l98la,b). 

Robertson  and  Wright  (1982)  derive  upper  and  lower  bounds 
—2  —2 

for  the  X  and  E  distributions  and  prove  that,  in  general,  these  bound 
cannot  be  improved  upon.  The  lower  bound  is  approached  using  U-shaped 
weight  sets  of  the  form  (a ,e ,e , • • • ,e ,b )  where  a,b  >  0  and  e  —♦  0. 

Tiie  upper  bound  is  approached  using  fl-shaped  weight  sets  of  the  form 
(e  ,e  ,••*,£  ,1  ,£,•*•  ,€  ,e  )  and  letting  e  — *  0.  This  is  for  odd 
k  where  k  =  2H+1.  The  obvious  adjustments  are  made  for  even  k. 

These  bounds  can  differ  substantially.  For  example,  for  k  =  5  the 

5  percent,  equal  weights  critical  value  is  5-0^9.  The  upper  and  lower 
_ 2 

bounds  for  pr  fxc  £  5.0^9]  are  .013  and  .096. 
w  q 

What  -li  the  note  oh  convergence  oh  pr  [x?  ^  t]  to  the  bound* ? 

w  5 

— o 

We  computed  pr  [Xr  ^  3-0 Up  ]  for  various  weight  sets.  Since  k  is  5 

W  ) 

*•*  :i  munoricnl  \  n  U'rrvLl,  i  on  on  in  Harlow  oi,  :t1  . 
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(1972),  an  exact  value  for  pr  [x"  ^  5.01*9] .  If  the  equal  weights  approxi- 

w  5 

mat. ion  is  good  then  this  should  be  close  to  .05.  For  each  weight  set  we 
;i. I  so  computed  the  ratio,  R,  of  the  largest  weight  to  the  smallest  weight 
in  order  to  gain  some  feel  for  the  likelihood  that  the  weight  set  might  be 
encountered  in  practice.  For  U-shaped  configurations  we  let 
w  =  (.1  ,e,e  ,e,l)  with  e  chosen  so  that  R  =  e  ranged  between  1  and  30. 
The  results  are  given  in  Table  1.  The  probabilities,  pr^x^  ^  5.0H9] 
decreased  from  .05  at  e  =  1  to  .021  at  e  =  .0333.  We  see  that  the  lower 
bound,  .013,  is  approached  rather  slowly. 

For  fi-shaped  configurations  we  let  w  =  (e  y/e  ,l,«/e  ,e )  with  e  again 
chosen  so  that  R  =  e  1  ranged  between  1  and  30.  These  results  are  also 
given  in  Table  1.  These  probabilities  increased  from  .05  to  .075-  Thus, 
ii  seems  that  while  the  range  of  probabilities  in  considerable  it  in  not  an 
extreme  as  the  bounds  suggest,  at  least  for  weight  sets  usually  encountered 
in  practice. 

kfiz  U-*haped  and  H-*haped  the  only  configuration*  0  f  weight*  f on. 
which  the  equal  weight*  cc**e  give*  a  poor  approximation? 

We  carried  out  a  "random  search"  for  weight  configurations  for  which 

_ 2 

prtx^  s  5-01*9]  is  not  close  to  .05.  Five  uniform  [0,l]  random  numbers, 
w  5 

U  ,U^ , • • • ,Ur ,  were  generated  and,  in  order  to  make  the  weight  sets  compar- 

.  -5 

able,  we  set  w.  =  U./L..  U.;  i=l,2,***,5.  We  repeated  this  process 
1  1  J  J 

_ 2 

10,000  times  and  for  each  weight  set  we  computed  pr  [xc  s  5 • 0U9 ]  and  the 

w  5 

ratio  of  tin*  largest  weight  to  the  smallest  weight  in  the  weight  set.  The 


10,000  ratios  ranged  from  1.1  to  something  larger  than  10,000.  Recall  that, 
because  of  the  bounds,  these  probabilities  must  fall  between  .013  and  .096. 

In  Table  2  we  have  reported  a  frequency  distribution  for  these  10,000 
probabilities.  All  10,000  probabilities  fell  between  .0219  and  .0803. 
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w  =  (l,e  ,e  ,e ,1) 

w  =  e) 

e 

R 

pr  [X?  s  5,0^9] 
w  5 

prw[^  *  5-01*9] 

1.0000 

1 

.0500 

.0500 

.5000 

2 

.01*20 

.0557 

.3333 

3 

•  0375 

.0590 

.2500 

1+ 

.031*6 

.0612 

.2000 

5 

.0321+ 

.0629 

.1000 

10 

.0267 

.0679 

.0667 

15 

.021*0 

.0705 

.0500 

20 

.0221* 

.0723 

.0U00 

25 

.0213 

.0736 

.0333 

30 

.0205 

.071*6 

— 2 

Table  1.  pr  txr  ^  5 ♦ 0U9 ]  for  various  weight  configurations. 

V  ; 


interval 

Fre¬ 

quency 

Mini¬ 

mum 

Ratio 

Maxi¬ 

mum 

Ratio 

Interval 

Fre¬ 

quency 

Mini¬ 
mum 
Rati  0 

Maxi¬ 

mum 

Rat.io 

[ .012, .016] 

0 

[.056, .060] 

1116 

2.2 

610.2 

[  .016, .020] 

0 

[  .060,  .061+] 

670 

3.1* 

<X 

[  .020,  .021+] 

1* 

20.8 

OO 

[  .061*,  .068] 

357 

5.0 

1*777.9 

[  .021*,. 028] 

22 

18.3 

571.2 

[  .068, .072] 

11*5 

6.9 

951*3.2 

[  .028, .032] 

73 

8.0 

21*50.7 

[.072,. 076] 

5l+ 

11+.9 

2075.1 

f  .032,. 036] 

281* 

5.2 

OO 

[  .076,. 080] 

17 

31*. 5 

1622.1 

[  .036,  .01*0] 

719 

3.1* 

00 

[  .080,  .081+] 

2 

812.0 

1597.7 

[  .0U0  ,  .01+1*  ] 

1319 

2.0 

1*052.0 

[  .081+,  .088] 

0 

[  .01*1+,. 01*81 

1781 

1.1* 

3531.9 

[  .088, .092] 

0 

[  .01*8,  .0521 

1876 

1.1 

2996.0 

[  .092, .096] 

0 

f .052,. 056] 

1561 

1.1+ 

161*8.8 

1 1  •  1  c  Fr 

(V 
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The  number  of  these  probabilities  which  fell  between  .OHO  and  .060  was 
T ^ 5 3 -  We  would  feel  that  for  these  weight  configurations  the  equal  weights 
case  provided  an  adequate  approximation. 

Large  ratios  are  not  necessarily  associated  with  poor  approximations. 
However,  every  ratio  which  is  associated  with  a  probability  outside  of 
(  .0H8 ,  .05? 3  in  at  least  1 .  ,  indicating  that  if  the  ratio  of  the  largest 
weight,  to  the  smallest  weight  is  less  than  l.i)  the  equal  weights  case 
should  provide  a  very  good  approximation.  Every  ratio  which  is  associ¬ 
ated  with  a  probability  outside  of  .0U  to  .06  is  at  least  3.^  indi¬ 
cating  that  if  the  ratio  of  the  largest  weight  to  the  smallest  weight  is  less 
than  3.k  then  the  equal  weights  case  should  provide  an  adequate  approximation. 

in  another  study,  the  weights  were  randomly  generated  in  such  a  way 
that  the  ratio  of  the  largest  weight  to  the  smallest  weight  was  constrained 
so  that  it  will  not  exceed  a  particular  value.  For  example,  we  randomly 
generated  the  values  of  U.  (recall  that  w.  =  U./LlJ.)  in  the  interval 

i  ill 

I  )/•’,. i/2].  Thus,  the  ratio  will  not  exceed  3.  For  1000  such  randomly 

_ 2 

generated  weight  sets  all  1000  values  of  pr  [Xc  ^  5.0^9]  fell  in  the  inter- 

vai  [ .OHIO ,  .0592  ] .  Results  for  other  constraints  are  given  in  Table  3- 

The  quality  of  the  equal  weights  approximation  is  related  to  both  the 

amount  of  variability  in  the  weights  and  to  the  pattern  of  large  and  small 

weights.  In  fact,  it  may  be  more  directly  related  to  this  pattern  than  to 

the  amount  of  variability.  If  we  interpret  U-shaped,  very  broadly,  to 

mean  any  weight  pattern  with  relatively  large  weights  at  1  and  k  but 

at  least  one  relatively  small  weight  between  1  and  k  then  all  of  the 

_ -  > 

wci-'hl.  ceil  f  i  j'ura  I.  i  eii:;  for  which  pr  fv  b  ‘).0)|O|  is  very  small  have  a 

W 

L-.  h.-ipcd  configuration.  A  selection  of  10  of  these  weights  is  given 
in  Table  U. 
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fa,b  ] 

All  1000  values  of 

pr  [\c  s  5-01+9  ]  in : 

[1/9,10/9] 

[ .0328, .0670] 

[1A,5/M 

[ .0372,. 0627] 

f  1/3A/3] 

[-0389,-0613] 

[1/2, 3/2] 

[  .  oi+io , .  0592  ] 

[1,2] 

[ .01+1+3, .0559 ] 

[2,3] 

[ .0L66, .0535 ] 

— 2 

Table  3-  Limits  on  pr 

w  9 

the  ratio  of  the 

^  5.01+9]  when  weights  are  generated  to  control 

largest  to  the  smallest  weight. 

V 

8  pr  ixl  ^  5.0U9] 

w  7 

(  A 333,  .001+9  >  .0912,  .0U5I ,  .1+256) 

88.1+ 

.0261 

(  .  1*887 , .  09  A  , .  0562 , .  0069 , .  351+1 ) 

70.8 

.0873 

(  .  3288,  .0126,.  3777,.  002)+,.  2785) 

157.1+ 

.0312 

(  .  3521,. 0757,. 0059,.  1899,. 3761+) 

63.8 

.0311+ 

(  .  3168 , .  1112 , . 0078,  .01+59 ,  •  5183) 

66.1+ 

.0871 

(  .  5  392 ,  .0059 , . 0661+ , . 0607 , .  3278) 

91.1+ 

.0263 

(  .1+121+,  .0078,  .1156, .01+20, .1+222) 

51+.1 

.n2”l+ 

(  .  51+  59 , .  0012 , .  2 1+1 3 , .  0331+ , .  1782 ) 

1+51*. 9 

.0310 

(  .  A 7 ,  .0910, .  0?l+0 ,. 0366 ,.  3012 ) 

2? .  8 

.'■'279 

'  '+.  ,.0006,.  1629,. 098)+,. 2789) 

765 . 3 

.0  311 

1  1+ .  Weight  configuration:?  for  w!ii( 

"A 

£  s.nig+] 
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In  Robertson  and  Wright  (1982a),  it  was  shown  that  as  e  — < •  0 ,  the 

•  P  k  — 1 

distributions  corresponding  to  the  weight  sets  (l,e,e  )  and 

/  k-1  k-2  .  —2 

,€  ,• • •  ,1)  also  approach  the  upper  bound  for  such  \  distribu¬ 

tions.  So  we  interpret  H-shaped  broadly  to  mean  any  pattern  with  smal] 

we i gilts  in  both  extremes  or  several  adjacent  small  weights  at  either  extreme. 

_2 

All  of  the  weight  configurations  for  which  pr  fxc  a  5-01+9]  is  very  large 

w  5 

have  such  a  fl-shape.  A  selection  of  10  of  these  weight  configurations  is 
given  in  Table  5- 

In  Table  6  we  have  listed  a  selection  of  10  weight  sets  for  which  R 
_2 

is  large,  but  pr^fx^  s  5-01+9]  is  close  to  .05.  In  these  cases  there  was 
a  small  weight  at  one  or  both  extremes  and  another  at  a  nonadjacent  inter- 
r  position. 

In  summary,  tile  equal  weights  case  appears  to  give  fair  approxima¬ 
tions  except  for  weight  sets  having  a  U-shaped  or  a  H-shaped  (interpreted 
broadly)  pattern  of  large  and  small  weights.  Regardless  of  this  pattern, 
if'  the  ratio  of  the  largest  weight  to  the  smallest  weight  is  less  than  1.1+, 
the  equal  weights  case  gives  a  very  satisfactory  approximation  and  if  this 
ratio  is  less  than  3.1+  it  appears  to  give  an  adequate  approximation.  If 
tile  pattern  of  large  and  small  weights  is  not  either  U-shaped  or  H-shaped 
then  the  equal  weights  case  can  give  a  satisfactory  approximation  for 
weight  sets  having  ratios  much  larger  than  3-1+. 


An  .-i.pprux  i  in:  i.l,  i  <  in  based  upon  the  pattern  nP  1  argi  and  small we  i  glit.s  . 

Ciiu.se  (  19YI+)  found  a  good  approximation  for  an  important  special  case.  He 
was  thinking  about  an  experimental  situation  in  which  a  researcher  was 


A 
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w 

R 

Pr„ tX?  *  5.01+9] 

V  p 

( .0005 ,  .0382 , .  1+538 , .  36614 ,  .1U10 ) 

907.6 

.0789 

( .0128, .1719 ,  .14122 , . 331+0,  .0690 ) 

32.2 

.0729 

( .  3101 , .  1+265 , .  23 66 , , 02  39 ,  .0029 ) 

11+7.1 

.0721 

(  .  0Tl4T ,  •  19146 , .  3779 352  3 ,. 00  0  5 ) 

755.8 

.0730 

(  .0373, .1172, .5135, .3316, .0003) 

17H.7 

.0770 

( .0065,. 0902, .2685, .5091, .1257) 

78.3 

.0727 

( .01+11,. 2618,. 6850,. 0117,. 000l») 

1712.5 

.0827 

( . 0011,. 0 370,. 3111+,.  1+106,. 2399) 

373.3 

.0757 

( .2622,.  1880,. 5I4 39,. 0055,. 0001+) 

1359-7 

.0721 

( .0682,. 2726,. 3317,. 3271,. 0001+) 

829.5 

.071+0 

Table  5-  Weight  configurations  for  which 

pr  [x?  s  5-01+9]  is  large, 
w  5 

V 

R 

prfXe  *5.01+9] 

w  5 

( .0225, .2335, .1+097, .0016, .3328) 

273.1 

.01+91 

(  .1118,. 191+1,. 0032,. 61+53,-01+57) 

201.7 

.0i+9l+ 

(  .0021+,. 3551,. 0137,. 1820,.  1+1+67) 

186.1 

.01+92 

(  . 031  l+,.5l+13,. 0002,. 2891+,. 1377) 

2706.5 

.01+92 

(  .1276,. 0017,.  1+1+00,. 3283,.  1023) 

258.8 

.01+89 

(  .1232,  .0030, .2307,  .5197,  .1231+) 

173.2 

.0l+8l 

( .0636,. 3279,. 00 30,. 5030,. 1025) 

167.7 

.0510 

( .2966, .0783, .0806, .5392, .0052) 

103.7 

.0503 

( .5517,. 011+2,. 2521+,.  1777,. 001+1) 

13*+  .6 

.0515 

(  .0005,. 381+2,. 03l+9,.l678.  ,1+126) 

825.2 

.0516 

Table  6.  Weight  conf igurations  for  which  the  ratio  is  large  and 

—  O 

Pr  [Xr  11  5.01+9]  is  close  to  .05. 

W  ) 


interested  in  comparing  increasing  dosages  of  a  drug  to  a  zero  dose  con¬ 
trol.  As  Chase,  and  Williams  (1971,1972)  before  him,  noted,  "researchers 
often  increase  the  sample  size  on  the  zero  dose  control  over  the  sample 
sizes  of  the  nonzero  dose  levels."  Assume  that  the  control  is  indexed  by 
1.  Chase  developed  an  approximation  for  the  case  where  w  =w  =  •••  =  w 

c  j  K 

and  W-|_/W2  >  7  • 

First,  Chase  found  a  recursion  formula  for  the  limiting  values  of 

P  (i,k);  i=l,2,***,k  as  w  *♦  “  while  the  common  value  of  w  ,w  , •  ■  •  ,w 
W  -L  c.  j  K 

is  held  fixed.  We  denote  the  limiting  probabilities  by  Pa>(^,k).  Chase 

—2  —2 

tabled  critical  values  for  the  y  and  E  distributions  associated  with 
these  limiting  values.  For  values  of  (w^/w^)  between  1  and  00  he  found 

_l/2 

that  a  linear  interpolation  in  (w^/w^),  between  the  equal  weights  case 
and  this  limiting  case  gives  a  very  adequate  approximation.  For  example,  if 
C^  denotes  the  appropriate  critical  value  computed  from  these  limiting  level 
probabilities  and  if  C^  denotes  the  appropriate  equal  weights  critical 
value  then  the  approximate  critical  value  is  given  by  C  =  [l-(w  /w  )  }c 

1  c  00 

—1  /2 

+  (w  /w2)  C^.  Chase  gives  both  exact  (kill)  and  Monte  Carlo  (k>U) 

evaluations  of  his  approximation  and  concludes  that  they  provide  quite  sat¬ 
isfactory  results.  Our  studies  confirm  this  conclusion. 

Starting  with  Chase's  recursion  formula,  Robertson  and  Wright  (1982b) 
derived  the  generating  function  of  the  sequence  of  limiting  level  probabil¬ 
ities,  k=l,2,***.  This  generating  function  is  given  by 

/1/2  s  +  k  -  3/2\ 

for  k  =1,2,-"-  and,  in  turn,  yields  a  sharper  recursion  formula  for  the 


limiting  level  probabilities,  namely 


12 


Pjl,k+l)  *  (2k-l)Pjl,k)/(2k)  =  (2k)!/(22k(k! )?) 
Fjk+J,k+l)  =  Pjk,k)/(?k)  =  (l/2)k/k! 

Pji.k+l)  =  Pjjt-l,k)/(2k)  +  (?k-l)Pj/,k)/(2k). 


Using  this  relation,  it  is  a  fairly  simple  matter  to  write  a  computer  pro¬ 
gram  to  generate  F'J  i,k)  for  k  up  to  any  reasonable  value  such  as  30. 

Kor  k  s.  12,  these  probabilities  are  tabled  in  Robertson  and  Wright  (l9S2b). 

It  was  also  noted  in  that  work  that  the  limiting  values  of  P  (JL, k)  for 

w 

the  situation  in  which  w  =w  =  •••  =w  and  w,  /w  — ®  are  also  given 

_L  c  K—x  K  X 

by  PjJl,k)- 

We  develop  an  approximation  for  P  (A,k)  based  upon  a  pattern  of  large 

w 

and  small  weights  in  w.  We  first  obtain  the  limiting  values  for  the 

P  (4,k)  for  each  situation  in  which  the  w.  assume  one  of  two  values, 
w  i 

one  of  which  remains  constant  and  the  other  approaches  infinity.  The 
approximation  is  an  interpolation  between  the  appropriate  limiting  case 
and  the  equal  weights  case.  We  try  to  convey  the  basic  ideas  behind  the 
limiting  cases  by  heuristically  considering  some  examples. 

Suppose  k  =  3  and  that  w^=  w^  =<*>  while  w^=  1.  Let  px*  £  |i*  £  pt* 
be  t he  maximum  likelihood  estimates  of  pi^  ,pi?,pi^  subject  to  pt^  s:  pio  s;  pt^ 
arid  recall  that  P^(JL,3)  is  computed  under  the  assumption  that  pi^  =  pp,  =  PL, . 
W"  may  assume  that  their  common  value  is  zero  without,  loss  of  generality. 

Recall,  also,  the  pool  adjacent  violators  algorithm  for  computing 

£  £ 

U|,pi(  and  pi^.  This  algorithm  is  discussed  beginning  on  page  13  of  Barlow 

•  •t  al.  (  l‘>7  ')  .  The  value  of  w  ^  is  proportional  to  the  reciprocal  of  the 

variance  of  x..  Thus  x,  and  x,  are  degenerate  at  0  and  x„  is  a 
1  1  < 
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unit  normal  variable.  Either  >  0  in  which  case  forms  a  violation 

with  x^  or  x^  <  0  and  forms  a  violation  with  x^.  If  x^  <  0  then  it 

in  amalgamated  with  and  they  are  both  replaced  by  their  weighted  aver¬ 

age  and  assigned  weight  w^+w^,  which  behaves  like  w^ .  Since  the  weight 
on  x^  is  infinite  the  weighted  average  behaves  like  x^.  Similarly,  if 

il  mid  y.  miv  replaced  I ,/  1 .  1 1<  •  I  »-  weighted  a  vrii;'i  •  ,  ..r  and 


assigned  weight  w  +w  ,  or  v0.  Thus,  P  (3,3)  =0,  P  ( 1 ,3 )  = 

e-  5  J  W  W 

P(«1,»3)(1-2>  “d  P.(2-3)  -  P(.1>.2)(2>2)-  S1“e  p„d,2)  -  PJ2.2) 

for  any  0  <  w  ,w^  <  “,  the  limiting  values  are  both  1/2.  Noting  that 


V  =  Pm  ./„  3),  we  see  that  this  case  was  treated  rigor- 

va,o,aj  \-L,b/a,ly 

ously  by  Robertson  and  Wright  (1982a). 


Now  suppose  w^=w^=l  and  w^  =  Then,  x^  is  degenerate  at  0 
while  and  x^  are  unit  normal  variables.  If  <  0  <  x^  then  we 

will  have  three  Levels.  In  all  the  other  cases,  either  x^  or  x^  is 
amalgamated  with  x^.  When  one  of  these  amalgamations  takes  place  the  two 
variables  are  replaced  by  a  variable  which  is  degenerate  at  zero.  It  fol¬ 
lows  that  the  number  of  levels  is  one  less  than  the  sum  of  the  number  of 


levels  among  and  an^  the  number  of  levels  among  M ^  and 

Moreover,  these  two  numbers  of  levels  are  independent.  Thus,  the  sequence 
[p  (/,3)3f_,  in  related  to  the  convolution  of  the  sequence  [P^^  ,2) 

W  X  —  J_  X  -i 

ry  ?  Li 

with  itself.  Specifically,  if  {P  J  ,«°)  7j/=1  *  {P  J 1  ,p)  3^=]  =  f=2  t,hon 

C.  ir.  the  probability  of  1-1  levels,  i=?,3,^. 


I 


Now  consider  an  arbitrary  k  and  suppose  i^  <  i^  <  •••<  i.  is  an 
ordered  subset  of  {l,2,---,kj;  w.  =w,  =•••  =w.  =  1  while  the  other 

ll  '2  1 J 

weights  are  infinite.  Let  I  =  k-j  and  suppose  A  is  the  number  of  finite 


wight.:;  on  the  left,  and  B  is  the  number  of  finite  weights  on  the  right. 


Specifically,  ^  =  *2  =  ’  *  *  =  \  =  1 .  WA+1  =  Wk-B  =  "  and  Vh*"’ 

=  =1.  If  one  uses  the  pool  adjacent  violators  algorithm  to  order  the 

first  A+l  estimates  and  the  last  B+l  estimates,  then  in  the  former  case 
the  last  estimate  will  behave  like  x, with  infinite  weight  on  it  and  in 
the  latter  case  the  first  estimate  will  behave  like  with  infinite 

weight..  Thus,  the  number  of  levels  is  two  less  than  the  number  of  levels  among 

£  £.  £  # 

h,  ,  •  ■  ■  plus.  number  of  levels  among  ^A+ 1  ’ ' "  '  ’ B  ^  u;;  rium~ 

£  £ 

bet*  of  levels  among  Vb’-'-’V  Moreover,  these  three  numbers  of  levels 
are  independent.  The  probabilities  for  the  number  of  levels  among 

#  £  £  K 

(U,  ,  •  •  • ,  an^  aJttong  B,""",^*k  are  ^>:'-ven  by  Chase.  If  w^  =  1  for 

any  i  such  that  A+l  S  i  s  k-B  then  the  corresponding  x.  must  be 

amalgamated  with  one  of  the  degenerate  variables  to  one  side  of  x.  .  Thus. 

*  # 

the  probabilities  for  the  number  of  levels  among  B  are  simply 

t!i*  equal  weights  probabilities,  {P(i  ,l)  •  Thus  the  sequence  of  1  evel 

probabilities  is  related  to  a  convolution  of  three  sequences,  each  of  which 
is  easily  computed.  This  idea  is  most  succinctly  expressed  in  terms  of  the 
generating  function  of  the  sequence  of  limiting  level  probabilities  which 

we  denote  by  0  ,  (s). 

“,k 


B»,k(s)  =  s  WS)  VS) 


-2 

=  s  s 


r 

OA-l/A 

/s  +1  -1> 

,  /l/?  s+  B  -  1/f 

Is 

A  / 

'  I  > 

'  B 

1 1/2 

s+  a  -  i/a 

fl/2  s  +  B-  l/2\ 

[ 

A  ' 

l  I  > 

B  1 

A  f  i  r.  irons.  i  *  r<  *• » 1'  could  be  given  but.  it  would  provide  no  new  ins.  ights. .  The 
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I '(4,1)  are  tabled  in  Barlow  et  al .  (1972)  and  the  P  (i,A+l)  are  tabled 
in  Robertson  arid  Wright  (1982b). 

We  recommend  an  approximation  which  is  an  interpolation  between  eriti- 
cal  values  (or  P-values)  computed  from  \  or  E  distributions  associ¬ 
ated  witti  the  above  limiting  coefficients  and  distributions  associated  with 
the  equal  weights  case.  In  order  to  recommend  a  specific  approximation  we 
need  to  make  two  decisions.  The  first  decision  is,  for  a  given  set  of 
wei gilts  how  to  decide  which  are  large  and  which  are  small.  The  second  is 
how  to  interpolate.  The  criteria  for  choosing  large  and  small  weights  and 
the  method  of  interpolation  seem  to  be  interrelated  and  we  tried  a  very 
large  number  of  combinations,  evaluating  these  combinations  on  the  basis  of 
randomly  generated  weight  sets  as.  in  our  evaluation  of  the  equal  weight:: 
approx i mat i on . 

We  tried  calling  weights  large  if  they  exceeded  some  fraction  of  the 
largest  weight;  if  they  exceeded  some  fraction  of  the  sum  of  weights;  or 
if  they  exceeded  some  value  midway  between  the  largest  and  smallest  weights. 
W>-  tried  interpolating  on  various  powers  of  the  ratio  of  the  largest  weight 
‘o  i he  smallest,  weight  and  the  ratio  of  the  average  of  those  weights  we 
called  large  and  the  average  of  the  ones  we  called  small.  Choices  between 
combinations,  were  not  always  clear  but  almost  everything  we  tried  seemed  to 
b'  are t'. ’ruble  to  ;m  approximation  based  upon  the  equal  weights  rase  alori". 

Btis.'-d  upon  the:;*,  studies,  our  recommendation  is  to  call  weight.:  large 
i  f  bin  ■;/  <  xreed 


.*>5  min(Wj  ,w„. 


,w^)  +  .35  max(w  ,w? ,  • • •  ,w  ) 


l6 


and  to  interpolate  on  the  basis  of  the  ratio  of  the  1/3  power  of  the  aver¬ 
age  of  the  large  weights  to  the  average  of  the  small  weights. 

For  example,  suppose  k=5>  w  =  (l  ,1 .2 , 5 .6 ,1 . 1) ,  1) . 7)  and  we  are 

—2 

interested  in  a  5  percent  critical  value  for  the  \  distribution 
associated  with  these  weights.  Then  .65  min(w^ ,w^ , • • • ,wr )  +  .  35  max(w^  ,w^ ,  •  •  •  ,w 
=  .(>'>  •  I  +  .  lb  •  5 .  6  =  2.6l.  Thus,  call  the  first,  second  and  fourth  weights 
s trial  1  and  tiie  third  and  fifth  large.  The  values  of  A,  B  and  I  are 
given  by  A  =  2,  B  =  0,  I  -  2.  The  generating  function  of  our  limiting 
coef f i cients  is  given  by 


3  T 

Thus,  our  limiting  coefficients  are  Pj,  1,5)  =  — :> ,  Peo(2,5)  =  rr. 
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h'ojC  5,5)  -  -~r,  P0(i<,5)  =  P  5 , 5 )  =  0.  The  five  percent  critical  value 

-2 


of  th 


—2 

e  associated  X  distribution  is  U.8969.  The  five  percent  critical 

—2 

value  of  the  equal  weights  distribution  is  5-0^91.  The  ratio  of  the 

average  large  weight  to  the  average  small  weight  is  U.29-  Thus,  our 
approximate  9  percent  critical  value  is 


[1  -  (  H  . r-9 )_1  ^ 3 1  •  U.8969  +  (U.29) 


-1/3 


5.01)91  =  14.9906, 


The  actual  five  percent  critical  value  is 


5.0996 


and  the  actual 


-2 


X5 


distribution  associated  with  these  weights  has  the  probability. 


.0527,  to 
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the  right  of  1.9906.  In  other  words,  if  we  wanted  a  five  percent  test 
and  used  1.9906  as  our  critical  value  we  would  actually  have  d=.0527. 

This  approximation  also  seems  to  give  adequate  approximations  for  the  values  of 

P  ( X, k)  and  are  thus  adequate  for  computing  P-values.  In  this  example  the  actual 
w 

values  of  P  (l,5),"-,P  (5,5)  are  .1908,  .1+132,  .3008,  .0868,  .0081. 
w  w 

'I'h"  approximation  which  place:;  weight  (1.29)  ^  ^  on  tin:  equal  weight:; 

-1/3 

values  and  1  -1.29  on  the  limiting  values  yields  the  values  .1952, 

.1217,  .2997,  .0753,  .0051. 

We  evaluate  our  approximation  as  follows.  For  an  arbitrary  set  of  5 

weights  we  use  our  procedu;  •*  to  compute  an  approximate  5  percent  critical 

value,  a  ^(w) .  Since  k  is  5  we  can,  as  before,  compute  an  exact  value 

for  the  probability,  ^  a  (w)].  If  our  approximation  is  good,  this 

w  5  -05 

should  be  close  to  .05.  We  did  this  for  weights  of  the  form  w  =  (l, €,€,£,]) 
and  w  =  (e,^/e,l,^,e)  with  e  =  R-1  and  R  =  1,2,3,1,5,10,15,20,25,30. 

The  results  are  given  in  Table  7.  The  numbers  in  parentheses  are  the  values 
we  obtained  using  the  equal  weights  approximation.  It  should  be  noted  that 
the  approximation  based  upon  the  pattern  of  large  and  small  weights  per¬ 
forms  exceptionally  well  for  U-shaped  weight  sets. 

In  Table  8  we  have  reported  a  frequency  distribution  of  pr  [xc ^  a  (w)] 
for  10,000  randomly  generated  weight  sets.  All  10,000  probabilities  fell 
between  .0311  and  .0715  and  9,75l  fell  between  .0l0  and  .060.  Recall 
that  for  the  equal  weights  approximation  all  10,000  f'+ll  between  .0219  and 
.0803  while  7,353  of  these  probabilities  fall  between  .0l0  and  .060. 

The  result.:;  of  a  study  where  the  weight  sets  were  randomly  generated  so  as 


to  control  the  ratio  of  the  largest  weight  to  ttie  smallest  weight  are  given 
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Table  7 


w  =  (l,e,e,e,l)  w  =  {e,Je 


e 

R 

prw[*5*  a.05(w)] 

r  2  . 
prv  *5  * 

;  a  05^  ^ 

1 . 0000 

1 

.0500  (.0500) 

.0500 

( .0500) 

.5000 

2 

.0535  (.0420) 

.0514 

(.0557) 

•  3333 

3 

.0540  (.0375) 

.0522 

(.0590) 

.2500 

4 

.0539  (.0346) 

.0576 

( .0612) 

.2000 

5 

.0536  (.0324) 

.0588 

(.0629) 

.1000 

10 

.0520  (.0267) 

.0622 

(.0679) 

.0667 

15 

.0509  (.0240) 

.0640 

(.0705) 

.0500 

20 

.0501  (.0224) 

.0652 

( .0723) 

.0400 

25 

.0496  (.0213) 

.  0660 

(.0736) 

.0333 

30 

.0492  (.0205) 

.0667 

(.0746) 

prw[4  * 


a.05(w)1 


for  various  weight  configurations. 


in  Table  9.  It  is  interesting  to  note  that  for  the  6000  weight  sets 
generated  so  that  R  s  10,  the  approximation  gave  true  CL  levels  between 
. 0U  and  .06. 


In  Table  8  note  that  every  ratio  which  is  associated  with  a  prob¬ 
ability  outside  of  [.0U8,.052]  is  at  least  1.5.  This  is  only  slightly 
larger  than  the  value  we  obtained  for  the  equal  weights  approximation. 
However,  every  ratio  which  is  associated  with  a  probability  outside  of  the 
interval  [.0lj,.06]  is  at  least  b.J .  The  corresponding  value  for  the  equal 
weights  approximation  was  3-*+.  In  the  case  k  =  5  we  conclude  that  if 
the  ratio  of  the  largest  weight  to  the  smallest  weight  is  no  more  than  U.7 
then  this  approximation  should  provide  an  adequate  result. 

In  order  to  evaluate  our  approximation  for  larger  k,  we  again  con¬ 
sidered  randomly  generated  weight  sets.  With  k  =  10 ,  weight  sets  of  the 
*,10 

form  w.  =  u./L  u  ,  i  =  l,2,--*,k,  were  generated  and  for  each  weight 
1  1  1=1  .) 

set  a  Q^(w),  the  approximate  a  =  .05  critical  value  was  obtained.  Of 

_ 2 

course,  for  k  =  10,  the  true  value  of  pr  [y,_  ^  a  ._(w)]  cannot  be  cal- 

w  ^5  -05 

culated  for  arbitrary  weight  sets.  Hence,  it  was  estimated  by  Monte  Carlo 
techniques  based  on  H,000  iterations.  So,  ten  uniform  variables  were 
needed  for  each  weight  set  as  well  as  1+0,000  normal  variables  to  estimate 
the  appropriate  probability.  This  process  was  repeated  for  1000  weight  sets 
The  number  of  weight  sets  was  limited  by  the  amount,  of  computer  time  re¬ 
quired  for  these  results.  As  can  be  seen,  this  project  required  the  gen¬ 
eration  of  over  1+0  million  random  variables.  The  frequency  distribution 
for  the  estimated  probabilities  is  given  in  Table  10.  If  one  considers  the 
approximation  adequate  if  the  estimated  value  of  pr^fx^  ^  a  ^(w)]  is  in 
[  .  O'* , .  On  ! ,  then  it  is  interesting  to  note  that  07.7%  of  the  estimated 
valuer,  were  in  this  range.  This  is  a  slight  increase  over  the  case  k  =q; 
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I nterval 

Fre¬ 

quency 

Mini¬ 

mum 

Ratio 

Maxi¬ 

mum 

Ratio 

Interval 

Fre¬ 

quency 

Mini¬ 

mum 

Ratio 

Maxi¬ 

mum 

Ratio 

f .012, .016] 

0 

[  .056, .060] 

1*92 

3.3 

2117.6 

f  ,0l6,.020] 

0 

[  .060,  .061*] 

109 

5.1+ 

3101.1* 

[ .020, .02U] 

0 

[ . 06U , .068] 

28 

21.2 

951*5.8 

[  .02)*,  .028] 

0 

[ .068, .072] 

3 

122.5 

1*96.1+ 

[.028,-032] 

1 

79.3 

79-3 

[.072, .076] 

1 

1238.1 

1238.1 

[.032, .036] 

18 

18.9 

00 

[ .076, .080] 

0 

[ .036, . 0U0 ] 

86 

U.7 

1U1U.1 

[.080, .081*] 

0 

[.0U0,.0Mt] 

1+06 

3.5 

1026.5 

[  .081*,  .088] 

0 

[  .oui*,  ,oi+8] 

1730 

1.5 

00 

[ .088, .092] 

0 

[.0U8, .052] 

1*577 

l.l 

CD 

[.092,. 096] 

0 

[.052, .056] 

25l*9 

1.5 

871*7.9 

Table  8. 


_ 2 

Frequency  distribution  for  pr  [V  2 

w  5 

generated  weight  sets  and  a  -n  (w) 

•  u 


a  q<_(w)]  with  10,000  randomly 
computed  using  the  approximation. 


All  1000  values  of 
2 

[a,b]  Pr„tXq  ^  a  1  in: 

_ . _ w  5  •») _ 


[1/9,10/9] 

[.0396,. 0600] 

[1/1*, 5/1*] 

[.0l*25,. 0569] 

[l/3,l*/3] 

[  .01+31,  .0561] 

[1/2, 3/2] 

[  .01*1+3,. 051*8] 

[1,2] 

[  .01*63,  .0529] 

[2,3] 

[  .01*78,. 0520] 

_ 2 

Table  9*  Bounds  on  pr  [y„  ^  a  „^(w) ]  when  the  weights  are  generated  so 

w  5  .09 

that  the  ratio  of  the  largest  weight  to  the  smallest  weight  is 
controlled. 


A 
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a. id  is  .'in  indication  that  the  quality  of  the  approximation  is  maintained 
;ts  k  is  increased  to  k  =  10. 

For  further  evaluation,  we  considered  data  sets  in  which  the  values 

could  be  sample  sizes  for  testing  the  homogeneity  of  a  set  of  means  versus 

a  trend  alternative.  Under  the  assumption  of  equality  of  variances  these 

values  become  the  weights.  We  found  approximate  values  for  P  (2, k)  by 

w 

Monte  Carlo  techniques  based  on  I4 ,000  iterations  and  compared  these  values 
!  1  •  those  obtained  by  our  approximation. 

_o 

We  also  compared  the  tail  probabilities  of  the  two  X  distributions 
corresponding  to  these  two  sets  of  approximate  level  probabilities.  For 
example,  in  Table  2h.2  on  page  6l?  of  Neter,  Wasserman  and  Whitmore  (lr/''t) 
we  found  the  number  of  twin-engine  executive  jets  sold  annually  between 
I'yf'B  and  1977  by  an  aircraft  manufacturer.  Taking  these  10  numbers,  1  )*7 , 
17b,  150,  191,  188,  179,  200,  220,  208,  330,  as  our  weights  we  coming”! 

the  values  of  our  approximate  P  (A,k)'s  which  we  shall  denote  by 

w 

1'  (A, 10);  2  = 1 ,2 , • • •  ,10.  The  values  of  P  (4,10)  and  the  relative 

a,w  a,w 

frequencies  of  these  counts  which  we  denote  by  P  (ji,k)  are  resorted 

m,w 

in  Table  11.  The  agreement  is  good.  The  maximum  absolute  difference  of 
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Interval _ Frequency _ Interval  Frequency 


[.032,. 0361 

0 

[ .036, .040] 

T 

[ .040, .044] 

68 

[.044,. 048] 

265 

[.048, .052] 

365 

[.052,-056] 

204 

[ .056,-060] 

75 

[ .060,. 064] 

l4 

[ .064, .068] 

2 

[ .068,. 072] 

0 

Table  10. 


Frequency  distribution  of  estimated  values  of 
with  1000  randomly  generated  weight  sets  and 
using  the  approximation. 


prv[?0* 

a.05(w) 


.05 


!w)  ] 


corriDUted 


i 

P  U,1Q) 

m,w 

P  (i,10) 

a,w 

i 

.09425 

.09555 

2 

.28975 

.27445 

3 

. 32600 

. 32092 

4 

.19850 

.2049a 

5 

.07300 

.08018 

6 

.01600 

.02021 

7 

.00225 

.00333 

8 

.00025 

.00035 

9 

.00000 

.00002 

J.O 

.00000 

. 000^0 

Trtl-1  •*  1  i  . 


Comparison  of  P  (X,10)  with  P  (/,'<’')  f->r 

f  a,w  ’  m,w 

w  =  ( i  >i Y ,  171,  15n,  i'h,  iRR,  rp>,  2on,  ppo,  r-is. 


<  -,n) . 
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10  10  2 

1  ^i  =  1  Pm,w(i’10)P[XX-l  ^=1  PA,v(i’10)P[x/-l  Difference 


1  .53300 

.51*302 

.00903 

.71*873 

.35811* 

.0091*1 

.22856 

.23663 

.00807 

.11*935 

-15572 

.00637 

. 09722 

.10201 

.001*79 

.06306 

.06655 

.0031*9 

.01*076 

.01*325 

.0021*9 

.02627 

.02801 

.00171* 

-  .01688 

.01809 

.00121 

.01082 

.01165 

.00083 

:  1  .00692 

.0071*8 

.00056 

! .  •  .001*1*2 

.001*79 

.00037 

!  1  .00281 

.00307 

.00026 

|).  .00179 

.00196 

.  000.1 7 

15  .0011U 

.00125 

.00011 

—2 

Table  12.  Comparison  of  the  \ 

distributions  corresponding,  to 

Monte 

Carlo  and  approximate  values  of  PwU,10).  w  =  (lU7,  175, 
150,  191,  188,  179,  200,  220,  208,  330 ). 


2h 

for  a  significance  level  around  .05  the  difference  was  about  .003,  and  for 

a  significance  level  around  .01  the  difference  was  about  .0008. 

The  equal  weights  P(ji,10)  are  given  in  Table  A.  5  of  Barlow,  et  al . 

(.1972).  They  also  fit  the  P  (JL,10)  very  well  in  this  example  and,  in 

m,w 

fact,  they  fit  better  than  the  approximation  presented  here.  However,  both 

are  clearly  adequate  and,  in  general,  we  have  seen  that  the  approximation 

presented  here  outperforms  the  equal  weights  approximation. 

We  tried  a  number  of  weight  sets  with  values  of  k  larger  than  5, 

obtaining  similar  results  each  time.  For  example,  we  took  the  weights  to 

be  the  12  values  in  Table  20. of  Neter  et  al.  (1978).  The  12  weights 

together  with  the  approximate  and  Monte  Carlo  values  are  given  in  Table  13. 

—2 

We  also  computed  the  tail  probabilities  of  the  two  corresponding  x  dis¬ 
tributions  at  t  =  .5,1.0,* ••  ,U5.  The  maximum  absolute  difference  in  these 
bwu  functions  was  .002.  The  largest  difference  in  these  x  tail  proba¬ 
bilities  corresponding  to  Monte  Carlo  P-values  smaller  than  .15  was 
.00001.  Comparing  with  the  P(j£,12)  from  Table  A. 5  of  Barlow  et  al . 

(1072),  we  see  that  the  P  (j!,12)  fit  better  in  this  example.  In  fact 

a,w 

the  fit  for  tail  probabilities  less  than  or  equal  to  .15  is  remarkable. 
Another  weight  set  and  corresponding  P  (A,k)  are  presented  in 

3.  jW 

Table  lU.  The  weights  are  taken  from  page  513  of  Neter  et  al.  (1978).  The 

-2 

maximum  absolute  difference  in  the  two  X  distributions  corresponding  to 
Table  1 h  is  .01025  and  the  maximum  absolute  difference  corresponding  to 
Monte  Carlo  P-values  less  than  .15  is  .00^15. 

Thus,  we  have  further  evidence  that  the  quality  of  the  approximation 
hold:;  up  for  k  >  B. 
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i 

P  (1,12) 

m,w 

P  (1,12) 
a,w 

1 

.08600 

.09011 

2 

.26525 

.26311 

3 

.  321+25 

.31680 

U 

.20U25 

.21131 

5 

.09125 

.08831 

6 

.02250 

.02162 

7 

.00575 

.00172 

8 

.00075 

.00063 

9 

.00000 

.00006 

10 

.00000 

.00000 

11 

.00000 

.00000 

12 

.00000 

.00000 

Table  Ij.  Comparison  of  P  (l.k)  with  Monte  Carlo  valuei;  of  P  (-?,k) 
— - -  a,w  w 

for  k  =  12  and  w  =  (155,  ITS,  215,  93,  L?8,  111,  172,  158, 
197,  207,  95,  183). 
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» 

26 

V 

l 

p».»<'-15> 

P  (/ ,15) 
a 

r 

l 

.07175 

.06388 

2 

.21800 

.2125b 

i 

3 

. 30000 

. 300hl 

r 

lj 

23950 

.2U17I4 

- 

5 

.11900 

.12U59 

6 

.03875 

.Olt375 

7 

.01175 

.01085 

8 

.00125 

.00195 

9 

.00000 

.00026 

10 

.00000 

.00002 

11 

.00000 

.00000 

12 

.00000 

.00000 

» 

13 

.00000 

.00000 

»■ 

lit 

.00000 

.00000 

■  , 

15 

.00000 

.00000 

Table  1  H .  Comparison 

of  P  (X,k)  with 

a,w 

Monte  Carlo  values  of  P  (X  k) 

w 

for  k  =  15 

and  w  =  (55,  20, 

35,  lt5,  ItO,  25,  55,  30,  60,  1*5, 

35,  25,  U5, 

35,  30). 
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U.  Siskind's  approximation.  Siskind  (1976)  developed  a  very  good  approxi¬ 
mation  for  P^(-£,k)  based  upon  a  Taylor's  expansion.  The  level  probabili¬ 
ties  depend  upon  the  weights  only  through  a  matrix,  R,  of  partial  corre¬ 
lations.  Let  Q  be  the  correlation  matrix  corresponding  to  the  equal 
w  •  i  rlit::  r:i:n-.  Thinking,  of  the  level  probabilities  as  functions  of  this 
matrix,  Siskind's  approximation  was  based  upon  Taylor's  expansions  of  these 
level  probabilities  about  the  equal  weights  matrix,  Q.  His  approximation 
requires  the  values  of  certain  derivatives  of  the  P(X,k)'s  evaluated  at 
(>.  Siskind  provides  a  table  of  these  values  for  k  ^  8.  Thus,  his  tech¬ 
nique  is  only  usable  for  k  s  8. 

Let  s  „_(w)  denote  the  five  percent  critical  value  computed  from 
.05 

Siskind's  approximation  for  the  weight  set  w  =  (w^ ,w^  ,w^ ,w^  ,wrJ  of  size  5. 

_ 2 

Iri  Table  15  we  have  a  frequency  distribution  for  pr  [\t  £  s  .c(v)]  for 

w  p  .up 

2,000  randomly  generated  weight  sets.  All  2000  probabilities  fell  between 
.0253  and  .0515  and  1881*  fell  between  .0^0  and  .0515.  The  percentage 
which  fell  between  .0U  and  .06  is  slightly  less  than  the  percent  that 
f  11  between  these  values  for  the  approximation  based  upon  the  pattern  of 
large  and  small  weights.  It  seems  unlikely  that  Siskind's  approximation 
would  ever  give  a  value  larger  than  .052  and  this  is  a  very  distinct  advan¬ 
tage  for  this  approximation.  In  Siskind's  study  of  his  approximation,  he 
found  that  it  did  not  perform  well  for  U-shaped  weights.  In  those  cases 
his  approximation  produced  values  that  were  considerably  smaller  than  the 
true  tail  probabilities.  Recall  that  in  this  case  the  approximation  based 
upon  the  pattern  of  large  and  small  weights  performs  quite  well.  Siskind's 
approximation  seems  to  be  more  likely  to  give  a  very  low  value  than  the 
approximat.  i on  based  upon  the  pattern  of  large  and  small  weights  and  the 


Mini-  Maxi-  Mini-  Maxi- 

Fre-  mum  mum  Fre-  mum  mum 

Interval  quency  Ratio  Ratio  Interval  quency  Ratio  Ratio 


1 .012, 

.016] 

0 

[.056,. 060] 

0 

f  .016, 

.000] 

0 

[  .060, .061*] 

0 

f .000, 

.001*  ] 

0 

[.061*, .068] 

0 

[  .  Of’); , 

.028] 

1* 

196.8 

819.5 

[ .068, .072] 

0 

I  B, 

.082] 

lit 

70.5 

21*71.8 

[.072, .076] 

0 

[ .010, 

.o'i6] 

27 

27.9 

3126.6 

[ .076,. 080] 

0 

f  .0  i6. 

.01(0 

71 

20.7 

1076.2 

[.080,. 08h] 

0 

[  • '  o’tO  , 

.0M*  ] 

179 

7.1 

3383.0 

[  .081*,. 088] 

0 

:  .-u. 

.01.6] 

1.81 

2.9 

111*7.1 

[ .088, .092] 

0 

1  .'Oto, 

O'O  ] 

122)* 

1.3 

506.2 

[ .092,-096] 

0 

\  .  • , 

.056  ] 

0 

_ p 

Table  1!?.  Frequency  distribution  for  pr  [y,:  S  s  „,_(w)]  with  2000  randomly 

-  w  >  .Op 

generated  weight  sets.  The  value  of  s  0j.(w)  is  computed  usinp; 
Siskind's  approximation. 
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fact,  that  Siskind's  approximation  is  only  valid  when  k  i  8  is  a  definite 
drawback . 
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The  use  of  much  of  the  distribution  theory  developed  for 
order  restricted  inference  has  been  limited  by  the  lack  of 
computation  algorithms  for  the  "level  probabilities"  encountered 
in  that  theory.  An  approximation  for  these  level  probabilities, 
which  accounts  for  the  pattern  of  large  and  small  "weights"  is 
developed .  This  approximation  and  the  equal  weights  approxima¬ 
tion  are  examined  in  several  different  ways  including  the  use 
lof  randomly  generated  weight  sets.  Roth  apprnvimAtinns  appear 
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to  be  reasonable  for  weight  sets  having  a  moderate  amount  of  C 
variability.  The  quality  of  the  equal  weights  approximation, 
as  a  function  of  the  amount  of  variability  in  the  weights, 
deteriorates  more  quickly  for  certain  patterns  of  large  and 
small  weights  than  for  others.  Thus,  the  approximation  based 
upon  the  pattern  of  large  and  small  weights  is  a  significant 
improvement  over  the  equal  weights  approximation.  Finally, 
Siskind's  (1976)  approximation,  which  can  be  applied  if  the 
number  of  parameters  is  not  too  large,  is  discussed. 
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